Rabia Naz Khan ¹, Mohsin Ali Memon ¹, Hira Abid Khan ¹, Salahuddin Saddar ¹

Affiliations
1 Department of Software Engineering, Mehran University of Engineering and Technology, Jamshoro, PK

Abstract

Objectives: This research has been carried out to add interactivity and information transfer in digital format by adding technology in legacy paper based notice board system. Methods/Statistical Analysis: To achieve the above-mentioned objective, we have used Hand gesture recognition Technology. A Microsoft Kinect sensor is placed in front of the notice board to detect hand gestures which serves as the medium of interactivity. Through specified American Sign Language Number gestures user can make selections and interact with the system. For the detection of gestures Visual gesture Builder has been used which implements AdaBoost Trigger Algorithm. This framework uses Data Driven Machine Learning Algorithm to detect gestures. For the analysis, training and testing of the framework we have collected Gestures data for each predefined American Sign Language Number gestures from 0–9, from both Left and right hands, from 49 people. The machine learning algorithm was trained by 80% of the gesture data and was tested by rest 20% gestures. The approach got varying Confidence value (accuracy values) for each gesture depending on varying hand space, hand size, person’s height, clarity in gesture performance. The framework also tested based on both male and female candidates, the result for gender-based analysis is also formulated in graph. The confidence values vary from gesture to gesture for both male and female. Findings: The research come out with the results that this technique can be used to optimize and make static paper based notice boards system interactive. With this technique user is able to transfer the information or notice posted on the notice board to their digital platform by making selection and commanding using their hand gestures. This enabled the user to negotiate without changing the whole business model. Application/Improvements: This framework can be implemented on places where notice boards are used to deliver information to the users for example. Institutes, hospitals, stations etc. Using this system the user can easily interact with the notice boards and transfer information to their digital means.

Full Text